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DUAL - MODE CAMERA 
Inventor: David A. Monroe 
Background of the Invention 
Field of the Invention , 

The subject Invention is generally related to cameras and sensors and is specifically directed 
to a camera design that may use multiple imagers for day/night imaging, or for variable zoom. The 
design overcomes deficiencies of prior-art cameras wherein moving parts were required in the 
optical path, or wherein electronic zooming reduced image resolution.. The cameras described may 
be either analog or digital. 

Discussion of the Prior Art, 

Video cameras have become commonplace in modem hfe. Improvements in process 
technology have resulted in cameras offering high performance at steadily decreasing prices. While 
early cameras imiversally used vacuum-tube technology, modem cameras are solid-state devices 
using CMOS or CCD technology, 

CCD and CMOS image sensors are typically organized into a planar array of photosensitive 
cells in orthogonal axes. When gated ON, each cell accumulates incident photons, yielding a net 
electrical charge in the cell. At the end of a defined exposure time, the accumulated charges are 
sequentially transferred fi-om the exposed cells via switched-capacitor techniques. 

Since the individual cells are merely accumulators of photons, they offer little or no inherent 
discrimination between various wavelengths of light. Indeed, such sensor arrays are often used for 
imaging using near- or far-infrared illumination. As a result or this broad-bandwidth behavior, such 
cameras are useful to produce monochrome video. 

The overall dynamic range of such image sensors is limited. The top end of the dynamic 
range is limited by the cell's maximum-voltage capacity. That is, once the cell voltage has reached 
some specified maximiim value (typically in the range of 1 to 5 volts), the cell is xmable to retain any 
additional photon-induced charges. 

The bottom end of the cell's dynamic range, which defines its sensitivity to low lighting 
conditions, is lunited by imperfections in the array. There are two primary mechanisms. First, cell- 
to-cell nonuniformities exist in cell geometry, dark current, and sensitivity. These nonuniformities 
result in a fixed-noise pattem superimposed on images produced by the camera, even in the presence 
of a uniform illuminant. Second, thermal noise directly creates dynamic cell-to-cell voltage 
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inequalities, which appear as 'snow' in rendered scenes. These two sources of noise limit the 
ultimate sensitivity of the system at low levels of illumination, since the effective signal-to-noise 
ratio decreases as illumination decreases. 

A further reduction in sensitivity results if the array is configured to render color images. 
To render color images, the front surface of the array is overlaid with a color filter array such that 
adjacent cells are sensitive to different colors. A variety of such color filter schemes exist, including 
RGB, YCrCb, and Bayer patterns. While this enhancement does provide the array with a means to 
render color imagery, it reduces the overall sensitivity of the array. This reduction in optical 
sensitivity is due both to the non-ideal transmissivity of the filter to the desired wavelength, as well 
as to the elimination of energy at the remaining (non-desired) visible wavelengths. 

Due to the ongoing advancement of digital techniques, a trend towards image sensors of 
ever-increasing resolution is evident. When the primaiy market for cameras was in television-related 
fields, there was not much demand for cameras to exceed the traditional 350 TV lines / 480 scan 
lines common to broadcast television. Since then, a variety of video applications have emerged, 
driven by the emerging internet, digital still photography, and HDTV technologies. As a result, 
higher-resolution image sensors are in demand and are increasingly available. These higher- 
resolution imagers aggravate the problems of low-light sensitivity due to both their smaller cell 
geometries, and to the (typically) shorter exposure times they employ. 

Many visual surveillance applications demand superior performance under very subdued 
illumination, such as night imaging with moonlight or even starlight as the ambient illuminant. 
While some progress has been made in improving the sensitivity of monochrome CCD imagers, such 
as the Watec 902H, the imagers remain insufficiently sensitive for moonlight or starlight operation. 
Conventional CCD or CMOS imagers are unable to produce usable video vinder these conditions. 
This problem has been remedied by the use of image intensifier technologies. These devices 
typically use a thin wafer of microscopically perforated opaque photoelectric material, biased by a 
strong electric field. Photons incident on the front of the plate produce an avalanche of 
photoelectrons through the microscopic pore, and energize a phosphor coating on the rear of the 
wafer. Currently available devices may exhibit luminous gains of perhaps 0.1 Foot-Lambert per 
foot-candle, which is enough to allow their use under starlight-illuminated conditions. Various 
commercial and military products use this technology, such as the military PVS-10 night vision 
scope, or the commercial OWL products produced by B.E, Meyer. 

These image-intensifier devices have several operational limitations. First, the devices may 
be damaged if operated at 'normal' illuminations, such as daylight. Recent 'gated' and 'filmed' 
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designs largely eliminate this problem. Also, these image-intensifier devices are not capable of 
rendering color scenes and are thus used in monochrome systems only. 

As a result of the foregoing, separate cameras are generally required for operation under very 
low illuminations and for normal-to-low conditions. Prior-art systems not only use two image 
5 sensors; they use entirely separate optical paths including lenses. While this approach has utility, 
a significant weight and size penalty is incurred by the duplication of the lenses. This is particularly 
the case with night- vision cameras, which necessarily use very large lenses (160 mm and 310 mm 
lenses are commonplace) to increase the photon capture aperture of the system. 

Another approach used in the prior art is the use of movable mirrors in the optical path. In 
10 this approach, a pair of mechanically linked mirrors is used to selectively pass the optical flux 
through one path, which includes an intensifier, or through a second path, which does not have in 
intensifier. While this approach has merit in it's elimination of a redxmdant lens, it is not without 
drawbacks. One deficiency is in the difficulty of establishing precise physical positioning of the 
I S mirrors after they have been moved. This may be a serious deficiency if the system is used with a 
■fe high magnification lens with a correspondingly small field of view, or if the system is used as a 
weapon sight. Another deficiency of a moving-mirror system is the mere presence of moving parts, 
which inevitably reduces the ruggedness and reliability of the system. 
J^,, A related problem entails the need for image stabilization within the camera. Hand-held 

ff^ cameras are subject to the unavoidable vibration and tremors of the human hand. This problem is 
IP exacerbated when long-range telephoto lenses are employed; the viewed image is increasingly 
:;2 unstable as the magnification is increased. A variety of image stabilization techniques have been 
applied commercially. Typically, an orthogonal pair of gyroscopic sensors are disposed parallel to 
the image plane. The respective acceleration outputs are twice-integrated, then are used to correct 
the image position. An electronic technique, used in the Hitachi VM-H81 camcorder, offsets the 
25 image sensor array scanning clocks so as to compensate for instantaneous image displacement. An 
electromechanical approach is used in some lens adapters, manufactured by Canon. In this 
technique, a planar, optically transmissive object is placed in the optical path, and is mechanically 
articulated to displace the optical path as necessary to maintain a constant image position in the 
image plane. While usefiil, these approaches have their disadvantages. The optical method adds 
3 0 attenuation to the optical path, reducing the system' s signal-to-noise ratio at low illumination levels. 
The electronic method necessarily sacrifices a bordered area at the top and sides of the image, 
sufficient to cover the peak angular excursions of the image. This effectively reduces the overall 
resolution of the rendered image. 
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Summary of the Invention 

The subject invention is directed to a multi-imager camera, which is operable under extremes 
of illuminations, without the need for multiple optical paths. A single-lens system is employed, and 
a partially-reflective beamsplitting mirror is disposed to direct incoming images simultaneously to 
two or more sensors, respectively optimized for two different conditions, such as day/night operation 
or variable-zoom operation. This effectively overcomes the size and weight penalty incurred in a 
multiple-lens solution. 

Beamsplitting mirrors are well-known optical devices. Such mirrors have been employed 
in a variety of optical systems over the years, including color cameras. Early color cameras used two 
beamsplitting mirrors to trisect the optical path, optical filters for the three primary colors, and three 
monochrome sensor tubes. Beamsplitting mirrors are also used m a variety of other optical systems, 
such as interferometiy. As a result, such mirrors are well-known, and are commercially available 
in a variety of sizes and transmittance/ reflectance ratios. 

Since the transmittance and reflectance of such mirrors are well controlled, it is possible to 
optimize a single-lens, dual-path system for dynamic range. For example, the daylight/ color camera 
is used when illuminant levels are high. It is thus possible to select a mirror that diverts a small 
percentage of the incident light towards the daylight color camera, while diverting a large percentage 
of the incident light towards the low-light monochrome camera and/or intensifier. 

The addition of an image intensifier enhances the sensitivity of the device under conditions 
of low illumination. The intensifier is placed in the optical path at a point beyond the beamsplitting 
mirror, and in whichever path the mirror 'favors'. For example, if the selected mirror is 90% 
transmissive and 1 0% reflective, then the intensifier is located behind the mirror where it can receive 
the preponderance of the incident optical energy. Conversely, if the mirror is 90% reflective and 
10% transmissive, then the image intensifier is positioned to capture the reflected light fi-om the 
muTor. In either case, the fi-ont surface of the intensifier must necessarily be located in the image 
plane of the lens, as extended or displaced by the beamsplitting mirror. 

Image sensors and image intensifiers tend to have somewhat limited dynamic ranges. At 
high light levels, the devices may saturate or suffer physical damage. At very low light levels, the 
unage produced by the device may become noisy, as previously discussed. This difficulty may be 
largely overcome through the use of an iris mechanism, which acts to limit the amount of optical 
energy reaching the intensifier under high illumination. 

In an alternative embodiment, digital image sensors are advantageously employed to increase 
the overall system resolution. Moreover, multiple digital sensors may share a common address 
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and/or data bus, and may be selectively enabled. The selection may be automatic based on scene 
illumination, or may be manual. 

In another enhancement, stabilization of the image produced by a digital sensor is effectuated 
by measuring and twice integrating the angular acceleration in two orthogonal axes parallel to the 
sensor' s axes. Such instantaneous position information is then used to temporally offset the camera's 
scan timing signals, thus yielding a stable image. Alternatively, the instantaneous position 
information may generate an address offset in the read addresses used to access the imager array or 
its buffer, also yielding a stable image. 

In yet another enhancement, the individual optical paths may use relay lenses of different 
magnifications. It is thus possible to selectively 'zoom' a desired scene by selecting one imager or 
the other. This allows zooming without moving parts in the optical path. It also allows the scene 
to be zoomed without loss of image resolution, as is the case in prior-art systems which zoomed by 
scanning a subset of a scanned image. 

It is, therefore, an object and feature of the present invention to provide a dual day/night 
camera without the use of dual lenses. 

It is an additional object and feature of the subject invention to provide such day/night 
operation through the use of a partially-reflective beamsplitting mirror. 

It is another obj ect and feature of the present invention to enhance the low-light performance 
of the day/night camera through the use of an image intensifier device. 

It is another object and feature of the subject invention to employ digital image sensors, with 
the aim of providing enhanced image resolution. 

It is another object and feature of the subject invention to effect digital imager selection by 
enabling or disabling one or more digital image sensors that share a common bus. 

It is another object and feature of the subject invention to provide a means for selectively 
magnifying an image, without moving optical parts and without sacrifice of image resolution. 

It is yet another object and feature of the subject invention to stabilize the captured images 
by sensing angular movements of the sensor and adjusting the scan timing or read addresses thereof. 

Other objects and features will be readily apparent from the accompanying drawings and 
detailed description of the preferred embodiment. 

Brief Description of the Drawings 

Fig. 1 depicts prior-art day/night cameras, which use dual optical paths and sensors. 

Fig. 2 is a day/night camera using one optical path, two sensors, a beam-splitting mirror, and 
an electrical switch to select the desired camera output. 
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Fig. 3 depicts the day/night camera of Fig. 2, with an additional controUed-iris mechanism 
to provide increased dynamic range. 

Fig. 4 depicts the day/ night camera of Fig. 2, with the addition of an image-intensifier device 
to extend the low-hght sensitivity of the system. 

Fig. 5 depicts the day/night system of Fig. 4, with the addition of controlled irises to extend 
the dynamic range of the system, and to protect the image intensifier mechanism. 

Fig. 6 depicts a multi-imager camera using digital imagers. 

Fig. 7 depicts the day / night camera of Fig 2, using digital image sensors. 

Fig. 8 depicts the digital day/night camera of Fig.6, with the addition of an image-intensifier 
device and dual irises. 

Fig, 9 depicts the use of the invention to selectively zoom an image 

Fig. 10 is an example of a handheld embodiment of the system. 

Detailed Description of the Preferred Embodiments 

Referring now to Fig. 1 , a prior-art system is depicted, which uses two lenses and sensors to 
span the desired range of ambient illumination. Daylight operation is accomplished using daylight 
lens 2 and color image sensor 4. Nighttime scenes are captured by lens 6 and image sensor 8, which 
is a monochrome area sensor optimized for high sensitivity. Typically, the overall ambient 
illumination is detected by, as an example, aphotodiode 3. The resulting signal is buffered by buffer 
9, compared with a reference value by comparator 5, and used to drive a video source selection relay 
7. 

The disadvantages of such a typical system are readily apparent. The overall size, weight 
and cost are dramatically increased by the inclusion of the additional lens. 

An enhanced system, subject of the present invention, is depicted in Fig. 2. A single lens 10 
is used to direct a desired scene onto the sensor optics, consisting of beamsplitting mirror 12, 
sensitive monochrome sensor 16 and color sensor 14. The relative positions of the respective 
sensors 14 and 16 may be exchanged, if necessary, without departing from the spirit and scope of 
the invention. The beamsplitting mirror 12 is partially reflective, in some proportion designed to 
optimize the desired optical behavior. For example, if absolute nighttime sensitivity is the highest 
goal of the design, then the beamsplitter may be 5 percent reflective and 95 percent transmissive, 
so as to maximize the amount of optical flux that reaches the nighttime sensor. The appropriate 
sensor output is selected by switch 18. Note that switch 1 8 could be automated as depicted in Fig. 
1, through the use of an ambient light level sensor and relay. The selected sensor output signal 22 
is optionally displayed on viewfinder 20. 
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In Fig. 3, the basic system of Fig. 2 is enhanced with a driven iris, which serves to limit the 
amoxmt of incident light that arrives at the monochrome sensor 1 6 or, indeed, at the color sensor 14. 
The overall output video signal 22 is sampled by diode 72, filtered by capacitor 68, given a time 
constant via resistor 70, and appUed to iris driver 66. The iris driver, in tum, drives the iris actuator 
64 and the iris 60, so as to limit the output signal 22 if it increases to some predetermined level. This 
serves to limit and stabilize the amount of light incident on the sensors 14 and 16. 

Fig. 4 depicts the basic system of Fig. 2, as supplemented by thee inclusion of an image 
intensifier24. Since the image on the rear surface of the image intensifier is a simple planar image, 
a relay lens system 26 may be necessary to transfer the image from the rear surface of the intensifier 
24 to the monochrome sensor 16. Other techniques may also be employed to transfer the image, 
such as the fusion of fiber optic bundles between the intensifier and imager, or direct bonding of the 
intensifier to the imager. 

Fig. 5 depicts an enhancement to the system of Fig. 4. In Fig. 5, a second iris 80 is added, 
immediately in front of the monochrome sensor 1 6. This second iris is used to limit the amount of 
illumination reaching the sensitive monochrome sensor 16, preventing it from suffering from 
saturation when the intensifier output image is bright. The output signal from the monochrome 
sensor 16 is sampled by diode 90, filtered by capacitor 86, given a time constant by resistor 88, 
buffered by buffer 84, and drives the iris 80 via actuator 82. This effectively stabilizes and limits 
the output signal from the monochrome sensor 16. This approach frees the first iris 60 to control 
the overall output from the system, as depicted earlier in Fig. 3. 

Fig. 6 depicts a multiple-imager version of the system. Multiple digital imagers 100, 102, 
and 104, share a common address bus 108 and data bus 106. A camera selection signal 110 is 
appUed to multiplexer 1 1 2, which thereupon selects one of the sensors via enable lines 1 1 4, 1 1 6, and 
1 1 8. This method allows the selection of a desired camera. The individual cameras 100, 102, and 
104 may share a common optical path, as in previous examples which use a two-way beamsplitting 
mirror. The individual cameras 1 00, 1 02, and 1 04 may seperately optunized for different purposes, 
such as day vs. night, IX zoom vs. 2X zoom, etc. 

Fig. 7 depicts an enhancement to the basic system of Fig. 2, wherein the analog sensors are 
replaced with high-resolution digital sensors 14 (color) and 16 (monochrome). As before, a lens 
system 1 0 directs a desired scene towards the beamsplitter 12, thence towards the dual image sensors 
14 and 16. Images captured by these digital sensors are transferred to a suitable signal processor 30 
with associated program/data memory 32. The processor 30, among other tasks, controls the 
scanning of the selected image sensor 14 or 16, and produces a corresponding output signal 22 m 
a desired signal format, such as NTSC, PAL, or a digital format such as D-1 . A pair of orthogonal 
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gyroscopic accelerometers 34 and 36 is disposed in a plane parallel to the image plane of the 
monochrome sensor 16. Angular accelerations detected by sensors 34 and 36 are twice-integrated 
by processor 30, to derive a knowledge of the instantaneous angular position of the device. This 
information is then used to temporally offset the image sensor scanning signals produced by the 
processor 30, effectively stabilizing the image position. Alternatively, the instantaneous position 
information previously described may be used to variably offset the read addresses driven to the 
imager or it's bugger, again effectively stabilizing the image. A variety of user input pushbuttons 
38 are provided to allow user control of various camera parameters, for instance brightness, 
stabilization on/off, day/night mode, power on/off, etc. 

An additional benefit of the dual-digital-sensor system of Fig. 7 is the ability to scan the 
imager in reverse-pixel or reverse-Une order. This ability overcomes the optical problem imposed 
by the inclusion of the mirror; images that have been reversed vertically or horizontally by the mirror 
may be "re-reversed" electronically. 

An additional benefit of the dual-digital-sensor system of Fig. 7 is the ability to 'fuse' the 
two images. The monochrome sensor 1 6 is used to provide scene luminance information, while the 
color sensor 1 4 is used to provide chrominance information. Note that, since luminance information 
is provided by camera 16, it is possible to use non-traditional color filters on color sensor 14 to 
increase its resolution and sensitivity. For example, a simple CrCb filter could be used on color 
sensor 14, with no pixels wasted for detecting luminance. This effectively increases the color 
resolution by one-third. The processor 30 may be used to scale and merge the two information 
streams into one signal. This method is not possible in prior-art systems, which used movable 
mirrors. 

Fig. 8 depicts an enhancement to the digital system of Fig. 7, wherein the dual-iris 
arrangement of Fig. 5 is used to optimize the dynamic range of the system. As before, incident light 
reaching monochrome sensor 16 is controlled by iris 80, as driven by actuator 82 under processor 
control. This effectively prevents the sensitive monochrome imager from suffering saturation or 
overload. The intensifier 24 is protected by iris 60, driven by actuator 64, also under processor 
control. This iris serves to protect the intensifier device fi-om excessive illumination. The dynamic 
range of both imagers may also be improved by the inclusion of automatic gain control, used in 
conjimction with the irises. 

Fig. 9 depicts the use of the invention to achieve selectable *zoom' ratios, or magnifications, 
without moving optical parts and without reduction of image resolution. While the example in Fig. 
9 depicts a pair of digital imagers, analog imagers could be used to the same effect, A lens 10 
captures a desired scene and passes it to an optional image intensifier 24. The image thereupon 
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passes to a beamsplitting mirror 12, thence to a pair of imagers 140 and 146 via relay lenses 142 and 
144 respectively. The relay lenses are selected to have differing magnification ratios. In the 
example shown, relay lens 142 exhibits a magnification of 1:1, while relay lens 144 exhibits a 
magnification of 2:1. Imager 140 or imager 146 may be selected via CAM SELECT signal 152 and 
5 inverter 148. This effectively allows selection of a desired image, or selection of the same image 
with different magnification. As an example, lens 140 and imager 142 may render a scene 154, of 
some given angular field of view. When lens 144 and imager 146 are selected, a smaller field of 
view 156 is rendered, but at the same resolution as the previous, larger image. 

Fig. 10 depicts a preferred embodiment a handheld version of the device. A housing 46 
1 0 contains a lens 1 0, user controls 3 8, eyepiece 42, battery compartment access panel 46, and carrying 
strap 44, 

While certain features and embodiments of the invention have been described in detail herein 
2 it should be understood that the invention includes all improvements, modifications and 
^ enhancements within the scope and spirit of the following claims. 
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CLAIMS 

What is claimed is: 

1 . A multi-imager camera operable under extremes of illuminations from high ambient 
lighting conditions to low ambient lighting conditions without the need for multiple 
optical paths, comprising: 

a. a single primary lens system for directing a beam; 
5 b. a beam-splitting mirror adapted for receiving and distributing the beam 

directed by the single lens; 
c. the beam-splitting mirror including a dual-path diverting capability, wherein 
a first portion of the directed beam is diverted in one direction and a second 
portion of the directed beam is diverted in a second direction; 
10 d. a first image sensor for receiving the first portion of the directed beam; and 

a second image sensor for receiving the second portion of the directed beam. 

^0 2. The camera of claim 1 , further comprising an image intensifier associated with one 

=fl of the cameras for intensifying the image under low ambient lightmg conditions. 

3. The camera of claim 1, wherein the first diverted beam is a high ambient lighting 
m beam and the second diverted beam is a low ambient lighting beam. 

U 4. The camera of claim 1, wherein each image sensor is a digital image device. 

5. The camera of claim 1 , wherein at least one image sensor is a digital image device. 

6. The camera of claim 1 , further including a singled data bus for transmitting the data 
collected and processed by the image sensors and further including selection means 
for enabling and disabling alternative of the sensors in order to assure only one image 
sensor is transmitting data on the bus at any time. 



7. 



The camera of claim 6, wherein each image sensor includes an iris and further 
including a controller for selectively activating and deactivating each iris. 
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8. The camera of claim 6, wherein each image sensor includes an iris and further 
including a controller for increasing the dynamic range of each sensor through 
selective iris control. 

9. The camera of claim 7, wherein the iris controller comprises an iris driver and an iris 
actuator. 

1 0. The camera of claim 8, whereui the iris controller comprises an iris driver and an iris 
acutator. 

11. The camera of claim 1, wherein the first sensor is a color sensor and wherein the 
second sensor is a monochrome sensor. 

12. The camera of claim 1 1, further hicluding an image intensifier positioned between 
the mirror and the monochrome sensor. 

13. The camera of claim 12, further including a relay lens positioned between the image 
intensifier and the monochrome sensor. 

14. The camera of claim 1 3, further including an iris controller associated with the relay 
lens. 

1 5 . The camera of claim 1 4, fiirther including an iris controller associated with the single 
primary lens. 

1 6. The camera of claim 1 5, wherein each iris controller comprises an iris driver and an 
iris actuator. 

1 7. The camera of claim 1 , wherein the single primary lens system comprises a plurality 
of lens component movable relative to one another to permit zoom capability. 

1 8. The camera of claim 6, further including a processor for controlling the scanning of 
the image of the digital sensor and producing an output signal. 
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19. The camera of claim 18, further including an angular position management system 
for detecting and controlling the angular position of the system. 

20. The camera of claim 1 9, the angular position management system comprising a pair 
of orthogonal gyroscopic accelerometers disposed in a plane parallel to the image 
plane of the digital sensor for detecting angular accelerations in order to derive the 
angular position of the system. 

2 1 . The camera of claim 1 , further including a display device associated with the image 
sensors for displaying the output therefrom. 

22. The camera of claim 21, wherein the display device is a viewfinder. 

23 . The camera of clam 22, wherein the camera is housed in a single, handheld, portable 
unit. 
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Abstract of the Disclosure 

A dual camera system uses a single lens and no moving parts in the optical path. A single 
lens directs a desired scene to a partially reflective beamsplitting mirror, thence to a pair of image 
sensors. For day/night operation, one sensor may be optimized for nighttime sensitivity, while the 
other is optimized for daytime operation. Altematively, one optical path may have greater 
magnification, thus allowing electronic zooming with no resolution loss. The system may be 
enhanced with an image intensifier for nighttime operation; digital sensors for improved resolution, 
or orthogonal gyroscopic accelerometers for unage stabilization. Additionally, the monochrome and 
color images may be produced simultaneously and 'fused' algorithmically, yielding an improvement 
in sensitivity and color resolution compared with a conventional color camera. 
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